Dynamically-activated optical instrument for producing control signals having a self-calibration means

ABSTRACT

An optical controller is capable of surrounding a player with a radiation screen from a plurality of panels, and enables the player to produce control signals for interface with a controlled instrument such as a musical instrument, a video game processor, etc. The insertion of the appendage of the player can produce a functional control signal. The relative position of the insertion of the appendage can be determined, for example, as a result of the intensity of reflected radiation in the dispersing radiation screen. The video game processing unit can play either a conventional video game that usually accepts eight functional control signals, or it can utilize the full capacities of the control signals available from the optical controller. The player can simulate the movements of the video character to experience a more realistic game play action.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part of U.S. patent applicationSer. No. 07/776,669, filed Oct. 15, 1991, now abandoned.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates to dynamically-activated optical instruments forproducing control signals. More particularly, it relates to an opticalinstrument which is activated by dynamic stimuli, generally by motionsof an operator's body appendages, and produces signals which can controla musical instrument, a computer-operated visual game, or other devices.

2. Description of Related Art

Apparatus for producing sounds by radiation have been known in the artfor a long time period. They are based on the principle of producingradiation, modifying it, sensing the modifications, and translating thesame to signals, e.g., electrical or electronic signals, which, in turn,produce musical tones. The modifications of the radiation may beproduced by the motion of the operator's body in a space that istraversed by the radiation. The operator will be referred to hereinafteras "the player."

French Patent No. 72.39367 utilizes radar radiation. The player's bodyreflects the radiation towards a sensor and the Doppler effect isproduced, which generates signals that are translated into acousticfrequencies. The music may be generated as a function of the speed ofthe player's motion or of his distance from the radiation source.

French Patent No. 81.06219 uses laser radiation, which surrounds a spacein which the player moves and the tones are produced by the interceptionof a ray by the player's body.

U.S. Patent No. 4,429,607 describes an apparatus comprising a number oflight emitters and sensors adjacent thereto, tones being produced byreflecting back, e.g., by means of a finger, an emitted ray to thecorresponding sensor.

WO 87/02168 describes, among other things, an apparatus applying thesame tone-producing means as the above-described U.S. patent, but usingretroflective elements applied to the human body to produce reflectionthat is stronger than random reflection, due, e.g., to the ceiling.Alternatively, random reflections are neutralized by confining both theemitted and the reflected beams within a narrow tube. The applicationalso describes a way of producing different octaves by sensing the orderin which a plurality of laser rays are intercepted by the player's body.

PURPOSE OF THE INVENTION

It is a purpose of this invention to provide an optical apparatus whichis adapted to produce, in response to dynamic stimuli, control signalsfor generating sounds or musical notes, or optical images or the like,or operating safety devices or interfaces, which is free from all thedefects of the prior art apparatus.

It is another object of the invention to provide such an apparatus,which operates efficiently in any surroundings and is not affected bythe shape and dimensions of the room in which it is placed or by objectsthat may be present in it.

It is a further object of the invention to provide such an apparatuswhich adjusts itself to different surroundings.

It is a still further purpose of the invention to provide such anapparatus which requires only one source of radiation.

It is a still further purpose of the invention to provide such anapparatus which operates by means of any desired kind of radiation.

It is a still further purpose of the invention to provide such anapparatus which adjusts its sensitivity to radiation, so as toconstantly provide the desired response to the dynamic stimuli by whichit is activated.

It is a still further purpose of the invention to provide such anapparatus that is extremely simple in structure and economical to makeand to operate.

It is a still further object of the invention to provide a method forproducing control signals by producing radiation in an operatingenvironment, and producing control signals in a predetermined responseto activating dynamic stimuli, such as a player's appendages,independently of the characteristics of the operating environment.

It is a still further object of the invention to provide a uniqueoptical controller for use on a microprocessor video game system thatcan simulate a conventional controller in one mode of operation, andfurther provide, in another mode of operation, expanded controlfunctions for computer games that have been appropriately programmed toaccommodate an optical controller.

It is another object of the invention to provide an enhanced play of acomputer game designed for a conventional 8-function controller throughthe use of a 16-function or greater optical controller that can simulatethe conventional controller and further provide enhanced standardfunctions not normally available to a player.

It is another object of the invention to utilize a single source ofradiation, such as infrared radiation, and a single sensor, and to shapethe radiation emission space of the source to enable a simplifieddetermination of the location of an object in the radiation space.

It is a still further object of the invention to enable an opticalcontroller to distinguish between a player's hand/arm and foot/leg whenintroduced into a laterally-spreading radiation space from a singlesource of radiation.

It is yet another object of the invention to provide an opticalcontroller that can particularly accommodate video games of action suchas boxing, martial arts, sports, etc., while permitting the player toact out the role of the video character in real life simulation.

Other purposes of the invention will appear as the description proceeds.

SUMMARY OF THE INVENTION

The apparatus according to the invention is characterized in that itcomprises, in combination with a radiation source, at least oneradiation sensor, means for activating a controlled device in responseto radiation detected by the sensor, and means for regulating thesensitivity, or reactivity, of the activating means in such a way thatthey will not activate the controlled device in response to radiationreceived by the sensor in the absence of dynamic stimuli, but willactivate the same whenever such stimuli are present.

By "dynamic stimuli" it is meant those changes in the radiation receivedby the sensors that are produced by a person using the apparatus for thepurpose of rendering the controlled device operative to produce aneffect that is proper to it, such as musical tones in the case of amusical instrument, video control signals for game actions in the caseof visual games, the sending of appropriate commands in the case of aninterface and the like.

The source of radiation may be constituted by at least one emitter thatis part of the apparatus--that will be referred to as "internal(radiation) sources"--or by means that are not a part of the apparatusbut provide radiation in the space, in which the apparatus is intendedto operate--that will be referred to as "external (radiation) sources."Typically, an external source may be constituted by the lighting of theroom in which the apparatus is intended to operate.

Preferably, the apparatus comprises a number of panel units or"segments" (as they will sometimes be called hereinafter). Each unit orsegment comprises at least one sensor and, if the source of radiation isinternal, at least one emitter.

In a preferred form of the invention, the sensitivity regulating meanscomprise means for determining two received-radiation thresholds, anupper one above which the activating means activate the controlleddevice and a lower one below which they deactivate the controlleddevice, the gap between the two levels, wherein the activating meansremain inoperative, corresponds to a level of noise.

In a further preferred form of the invention, the sensor produces outputsignals in response to radiation received, and means are provided forsampling the signals, counting only the signals that are produced,within a certain time period, by radiation having an intensity above apredetermined minimum, and generating control signals in response to thenumber of the counted signals.

In a particular form of the invention, the activating and sensitivityregulating means comprise processor means and logic circuits foractivating emitter means to emit radiation pulses, sampling the sensoroutput signals in a predetermined timed relationship to the emittedpulses, deriving from the sampled sensor output signals a sensingparameter, comparing the value of the sensing parameter withpredetermined reference values thereof, generating control, activating,and deactivating signals, and transmitting the same to the controlleddevice, depending on the result of the comparison.

The word "radiation," as used herein, includes any kind of radiation,such as infrared, ultrasonic, visible light or laser radiation, ormicrowaves or other kinds of electromagnetic waves and, in general, anyradiation that may be emitted and received by means known in the art.

The expression "control signals," as used herein, includes anyelectrical or electronic signals or any signals that may be produced bythe activating means in response to sensor output signals due toradiation received by the sensor. The control signals, as alreadystated, are used to control other devices, most commonly musicalinstruments or computer-controlled visual games, or other computers orinterfaces and, in general, any computer-controlled or electrically- orelectronically-controlled devices, generally designated herein as"controlled devices." Since a typical--though not the only--use of theinstrument according to the invention is to control musical instrumentsor visual games, the person using the apparatus and producing orcontrolling the dynamic stimuli which activate it, will hereinafter becalled "the player."

The invention also comprises a method for producing control signals inresponse to dynamic stimuli, which comprises creating radiation in adefined space, sensing a physically, generally quantitatively, definablecharacteristic of the radiation received from one or more sensors,determining, in a zeroing operation, the value of a sensing parameter,having a predetermined correlation to the characteristic, in the absenceof dynamic stimuli--hereinafter called the "reference threshold value"of the parameter--and thereafter, in the normal operation of theapparatus, repeatedly determining the value of the same sensingparameter and producing a control signal whenever a predetermineddeviation from the reference threshold value is detected. The radiationcharacteristic will generally be defined in terms of intensity, but maybe defined otherwise, e.g., in terms of frequency, etc. It may not, andgenerally will not, be quantitatively determined since it isrepresented, in carrying out the invention, by the sensing parameter.The sensing parameter may be defined, e.g., as a number of pulses in agiven time interval, or may be defined in terms of different variables,such as a time elapsed between emission and reception of radiation, afrequency, etc. The correlation between the sensing parameter and thecharacteristic may be an identity, viz. the parameter may be a measureof the characteristic, or the parameter and the characteristic may bedifferent even in nature, and any convenient correlation between themmay be established, as will be better understood hereinafter. Thecorrelation may be wholly empirical and it may vary in differentoperating environments and/or circumstances, as will be betterunderstood hereinafter.

Preferably a different control signal is associated with each sensorand, therefore, with each point at which the received radiation issensed. For instance, the output signal associated with each sensor maybe used to produce a given musical tone, by which term is meant anysound having musical significance and, in general, a definite pitchwhich, in the customary scales, such as the chromatic scale, isphysically definable in terms of basic frequency and octave, or it mayproduce an instruction to a computer to carry out a given operation,such as the production of an image or its modification or displacement,or any other predetermined action of any device controlled by theinstrument according to the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

The objects and features of the present invention, which are believed tobe novel, are set forth with particularity in the appended claims. Thepresent invention, both as to its organization and manner of operation,together with further objects and advantages, may best be understood byreference to the following description, taken in connection with theaccompanying drawings.

FIG. 1 schematically illustrates a polygon controller made from eightunits, according to a preferred embodiment of the invention;

FIGS. 2a-2d schematically illustrate the emitters and sensors of a unitaccording to another embodiment of the invention;

FIG. 3 is a diagram illustrating the operation of a device according toanother embodiment of the invention;

FIG. 4 is a block diagram schematically illustrating the relationshipbetween the units, the central processor, and the interface to the gameor instrument, and the flow and processing of information;

FIGS. 5 and 6 are electronic diagrams of component parts of a specificembodiment of the invention and, more precisely, of a control circuitand a panel circuit, respectively;

FIG. 7 is a schematic diagram of a panel circuit for another embodimentof the invention;

FIG. 8 is a flow chart of a calibration and operator-sensing mode ofoperation;

FIG. 9 is a perspective illustrative view of a video game operation;

FIG. 10 is another perspective illustrative view of a video gameoperation;

FIG. 11 is a diagram of a program flow chart;

FIG. 12 is a diagram of a program flow chart; and

FIG. 13 is a diagram of a program flow chart.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

The following description is provided to enable any person skilled inthe art to make and use the invention and sets forth the best modescontemplated by the inventors of carrying out their invention. Variousmodifications, however, will remain readily apparent to those skilled inthe art, since the generic principles of the present invention have beendefined herein specifically to provide an optical controller forproducing control signals.

In the preferred embodiment illustrated in FIGS. 1 and 2a-d, theapparatus according to the invention comprises a number of panel unitsfrom 1 upwards to 8 in the specific example illustrated, but this numberhas no particular significance and may be changed at will. Each panelunit has the form of a segment 10, so that the succession of thosesegments in mutual abutment constitutes a polygon, the player generallystanding inside the polygon itself. Each segment 10 comprises a bottomportion or base 11 and a top portion or cover 12, connected to the basein any suitable way. In FIG. 2a cover 12 is shown as removed from thebase 11 and turned upside down, to show its inner surface. Base 11carries a single emitter assembly generally indicated at 31 (althoughthis latter may be omitted, as will be explained hereinafter) and asensor assembly generally indicated at 15. The top cover 12 is providedwith a window 24, over the emitter assembly, and a window 26, over thesensor assembly. The emitter assembly comprises an emitter 13, which maybe, e.g., an LED (light-emitting diode) such as an infrared emittingdiode or any other kind of emitter, and preferably, but not necessarily,means for directing the emitted radiation beam in a predetermineddirection such as an optical lens assembly. In the embodiment described,the optical axis or direction of the beam is essentially vertical and isobtained by concentrating the radiation emitted by the LED by means of acylindrical lens 20 and directing it onto a mirror 22, slanted at about45 degrees to the vertical, from which the beam is reflected generallyupward. These elements are shown in perspective in FIG. 2b. Thereflected radiation passes through window 24 and forms anupwardly-directed beam. The beam, of course, is outwardly flared fromits vertex, viz. from the level of the emitter, upward, and has thegeneral shape of a pyramid having a generally quadrilateralcross-section or base. The geometry of its base depends on the lens 20which, being cylindrical, tends to produce a beam that is elongatedparallel to the direction of the lens axis. The specific intensity ofthe radiation, viz. the amount of radiation which passes through a unitsurface of a horizontal cross-section of the beam, decreases from thevertex of the emission space upward.

The sensing assembly 15 comprises a mirror 25, slanting at about 45degrees to the vertical, on which radiation reflected by the ceiling ofthe room in which the apparatus is placed, or by any other reflectingbody which crosses the emission space, impinges after having passedthrough opening 26 of cover 12, aligned with the mirror. Mirror 25reflects the radiation to lens 27, these elements being shown inperspective in FIG. 2c. From lens 27 the radiation reaches cylindricallens 32, shown in perspective in FIG. 2d. From cylindrical lens 32, theradiation reaches a sensor, e.g., a photoelectric cell 14, whichproduces an electrical signal in response to the radiation received. Thegeometry of the sensing assembly determines a different sensing beam foreach unit 10 so that the units will not interfere with each other--viz.the optical components described and the openings in the cover 12 are sodimensioned and positioned that only the radiation from a certainspace--"sensing beam"--reaches each sensor, and the radiation whichreaches any given sensor does not reach any of the others. It will beunderstood that the optical components previously described and theirdisposition are not critical, and any skilled person can selectcomponents that are different in whole or in part and arrange them in atotally or partially different way in order to obtain the desiredemission and sensing beams. As already noted, it is not necessary thateach segment 10 should comprise an emitter assembly. The apparatusaccording to the invention may comprise, instead, one or more separateemitters, each of which emits radiation that will be received by morethan one sensor, in which case there will not be associated with eachsegment an emitter assembly and an emitter beam.

The operation of a single element of the apparatus, viz. an emitter anda sensor, which, in the embodiment described, are associated with agiven segment 10, will now be described. It will be understood that thesame operations will take place for all other elements, althoughpreferably not at the same time, in order to avoid interference betweendifferent elements. In other words, a central processor or computer suchas that schematically indicated in FIG. 4 (which figure isself-explanatory), e.g., a microprocessor, will activate the severalelements of the apparatus at successive time intervals, which, however,are so short as to give the effect of a continuous operation of theapparatus. It will also be understood that, as already stated, anemitter may cooperate with different sensors and, thus, may beconsidered as a part of a plurality of elements of the apparatus. In theembodiment illustrated, the radiation is emitted by pulses. Thefrequency of the pulses may be controlled by the central processor. Letus assume, by way of example, that it is 2000 pulses per second. Thesensor of the element under consideration generates an output signal inresponse to a pulse received, which is also a pulse, the length orduration of which increases with increasing intensity of the radiationreceived. To distinguish it from the pulses sent by the emitter, it willbe called "sensor pulse" or "sensor signal." When the processoractivates the element, it triggers the emission of the pulses by theemitter. After a certain time, the processor samples the output of thesensor. The time elapsed between the triggering of the emission and thesampling of the sensor output will be called "sample delay time" andindicated by SDT. The SDT can be changed by the computer. It influencesthe operation of the apparatus and, therefore, it is desirably set at anoptimal value, the determination of which will be explained hereinafter.

When the computer samples the sensor output, it senses and registers ateach sampling whether a sensor signal is still being sent. If the sensorhas not received an emitter pulse and, therefore, has not responded bysending a sensor signal, or if it has received a weak emitter pulse andhas therefore sent a sensor signal that has lasted less than the timeSDT, the computer will register the absence of such a signal (zero). Ifthe sensor has received an emitter pulse strong enough to cause it toemit a sensor signal the duration of which exceeds SDT, the computerwill register the existence of the signal (one). The computer will countthe number of sensor pulses (ones) it detects during a given length oftime or "measuring cycle." The maximum number of sensor pulses thatcould be detected during a measuring cycle is obviously equal to thenumber of emitter pulses that have been sent during the cycle, whichdepends on the duration of the cycle and on the frequency of the emitterpulses. In this example, it is assumed that the maximum number of sensorpulses is 64, corresponding to a duration of each measuring cycle ofabout 1/30-second (more exactly 64/2000). It is seen that the number ofsensor pulses detected in each measuring cycle, which will be called"intensity number" and will be indicated by IN (and is comprised in thecase described between zero and 64) provides a measure of the intensityof the radiation received by the sensor and is, in this embodiment, thesensing parameter. However, the radiation intensity and the number IN ofsensor pulses detected are not proportional, since the latter number isinfluenced by other factors, mainly by the value of SDT, as it is clearthat if SDT increase, more sensor pulses will go undetected, all otherthings being equal.

The operation by which the apparatus is prepared for operation in agiven environment, which will be called the "zeroing operation," willnow be described with reference to a single sensor. During the zeroingoperation, none of the dynamic stimuli that will be applied to theapparatus and to which the apparatus will react in normal operation, arepresent. The apparatus is started and the emitters begin to emit IR (orother radiation) pulses controlled by the computer. The sensor willoutput sensor pulses and the computer will sample them and compute theIN value by counting the pulses--all as explained previously--and willregister the value in its memory, all within a few thousands of a second(e.g., 30 milliseconds). Since no dynamic stimuli are present during thezeroing operation, the value may be called "idle mode intensity number"and indicated by IDN. IDN is the reference threshold value of thesensing parameter IN. Due to the internal and external electronic andoptical noise, this number is not stable and varies from measuring cycleto measuring cycle. Its maximum variation will be called "noise number"and indicated by NN. It is determined empirically by operating theapparatus in the environment in which it is intended to operatenormally, which is the same in which the zeroing operation is carriedout, and under normal conditions, e.g., normal room temperature, andmeasuring IDN repeatedly over a sufficient length of time, e.g., onehour. Alternatively, NN could be calculated by summing all thecontributions of the various components, e.g., sensor noise, amplifiernoise, digital noise, external induction noise, optical noise fromexternal radiation sources, etc., each of which is individually known oreasily determined by persons skilled in the art.

According to an elementary embodiment of the invention, the apparatuscould be programmed in such a way as to actuate the controlled device,be it a terminal device or an interface to a terminal device, to performits operations when the apparatus is subject to a radiation theintensity of which corresponds to a sensing parameter IN equal to ormore than the reference threshold value IDN, viz. which is not higherthan the radiation it would receive in the absence of dynamic stimuli(as this expression has been defined previously). Thus the controlleddevice would be activated when at least one sensor receives a radiationmore intense than that expressed by IDN and deactivated when all sensorsreceive a radiation equal to or lower than that expressed by IDN.However, the presence of noise might cause the controlled device to beactivated in the absence of dynamic stimuli. To avoid this, theactivation threshold should be increased by NN.

It is desirable to control the sensitivity of the apparatus, viz. theintensity of the dynamic stimulus that is required in order that theactuated device will respond. For this purpose, both activation orhigher and deactivation or lower thresholds are increased by a factorthat will be called the "sensitivity number" and will be indicated bySN. In this way the apparatus will only respond to dynamic stimuli thatare not too small and the minimum intensity of which increases withincreasing SN. The lower and higher thresholds, indicated respectivelyas OFFIN and ONIN, will be expressed by: ##EQU1##

SN is determined empirically by operating the apparatus under normalconditions and varying it until the apparatus responds satisfactorily toa given dynamic stimulus: e.g., the action of a typical object, such asthe hand of the player or an optically equivalent object, at a typicalheight, e.g., 1.2 meters, at the center of the area in which the playernormally operates. The value of SN, as well as that of NN, areregistered in the computer's memory as known parameters, as part of thezeroing operation.

It will be clear from the above description that the first parameter tobe determined or, more correctly, to which an optimum value must beattributed, in the zeroing operation, is SDT. The sensors have a typicaldelay time between the time they receive the optical pulse and the timethey generate the electronic response. As mentioned earlier, the lengthof the response signal is proportional to the intensity of the opticalsignal received. In order to optimize SDT, its value is set at first asclose after the delay time as possible, in order to achieve maximumsensitivity. This value will be called "initial SDT"--ISDT. A weakoptical signal will cause the sensor to generate a short electronicpulse, but it will still be identified by the processor because itsamples the output of the sensor right after the pulse is started. Theprocessor will measure the IDN using ISDT. If the resulting number istoo high in order for OFFIN and ONIN to be in their designated rangebecause of a very strong optical signal (IDN>64-(NN+SN)), the processorwill lower the sensitivity by incrementing the SDT by 1 microsecond, andcheck the IDN again.

By incrementing SDT by 1 microsecond, the processor samples the outputof the sensor 1 microsecond+ISDT after their response. Only emittedoptical signals which cause pulses 1 microsecond+ISDT to be generated bythe sensor will be identified by the processor. These pulses have to bestronger in their intensity. The processor will repeat this procedureuntil the sensitivity decreases so that IDN reaches a satisfactoryvalue, which should be in the range: 0<IDN<(64-(NN+SN)). The SDT whichproduces the result will be registered in the processor's memory andmaintained in the normal operation of the apparatus, at least unless anduntil a change of environment makes a new zeroing operation necessary.It may be called "working SDT" and indicated by WSDT.

These operations are illustrated in the diagram of FIG. 3, wherein theabscissae are times and the ordinate is the number of sensor pulsescounted in a measuring cycle. At the beginning of the zeroing operation,indicated by segment 40, SDT is very small and, as a result, IN is toohigh (64 as shown in the diagram). SDT is then increased by 1microsecond (segment 41) whereby IN decreases to 60, which is still toohigh. SDT is repeatedly increased, producing the successive segmentsshown, and IN decreases, until an IN of 40 is reached (segment 42). Thisis a satisfactory value, for, with the values of SN and NN which havebeen previously established, ONIN is 60, comprised in the 0-64 interval.The SDT which has produced the value of IN--which is taken as IDN=40,based on which ONIN and OFFIN are calculated--will be used throughoutthe operation of the apparatus and, therefore, becomes WSDT. Slantedlines 43 and 44 illustrate how the apparatus will work in normaloperation. If a dynamic stimulus is present, IN will rise from IDN to60, which is ONIN, and the controlled device will be activated. If thedynamic stimulus ceases, IN will decrease from 60 to OFFIN, at whichpoint the controlled device will be deactivated.

The two thresholds OFFIN and ONIN are actually numbers of pulses countedin a measuring cycle, viz. their dimension is sec⁻¹. Of course, NN andSN are expressed in the same units. If the number of pulses emitted bythe emitter is 64 per measuring cycle, as has been assumed herein by wayof example, both OFFIN and ONIN must be comprised between zero and 64.Increasing the number of emitted pulses increases not only the accuracyof the apparatus, but also its response time, while decreasing thenumber decreases both accuracy and response time. Since high accuracyand low response time are desirable, a compromise must be reached. Inmost practical cases, setting the number of pulses at 64 per measuringcycle achieves a good compromise.

During normal operation, the computer checks the IN every 30-40milliseconds. If the IN value rises above ONIN, the computer operates an"on" signal, viz. activates the controlled device (e.g., video/computergame, electronic musical device or interface). If the IN value isbetween OFFIN and ONIN, no change is effected and the controlled devicecontinues to operate or not to operate, as the case may be. If the INvalue decreases below OFFIN, the computer generates an "off" signal,viz. deactivates the controlled device. The gap between the twothresholds prevents noise from sending such "on" and "off" signals atinappropriate values of IN.

When more than one sensor is employed, each sensor will be assigned itsown specific SDT, OFFIN, and ONIN values, and the computer will comparethe IN of each sensor with its specific parameters, and will produce"on" and "off" signals accordingly.

In this embodiment of the invention, the intensity of the radiationreceived by a sensor is the quantitatively definable characteristic ofthe radiation received. The number of sensor pulses counted by theprocessor in a measuring cycle is the sensing parameter. The correlationbetween the parameter and the characteristic is the relationship betweeneach intensity of radiation and the corresponding number of sensorpulses, which relationship depends on the apparatus characteristics andon the particular SDT chosen. The reference threshold value of thesensing parameter is the number of pulses IN measured in the environmentin which the apparatus is intended to operate and in the absence ofdynamic stimuli. The deviation from the reference threshold value whichcauses the production of a control ("on" or "off") signal is apredetermined deviation of the sensing parameter, in excess, from thethreshold value--preferably a deviation in excess of the sum of thenoise number and the sensitivity number, as previously defined.

The zeroing operation has been described with reference to a singlesensor. The computer will relate separately to each sensor in theapparatus and if, e.g., there are eight segments and eight sensors inthe apparatus, the computer will concurrently zero each one of themindependently. Depending on the shape of the room, the objects containedtherein and the position of the apparatus within it, the variousparameters, including the measuring cycle, used or established inzeroing the apparatus, may be different from sensor to sensor and fromunit 10 to unit 10.

When the instrument is used, a player is stationed in the playing area,which is, in general, the area within the polygon defined by thesegments 10, and moves parts of his body in such a way as to producedynamic stimuli, by creating changes in the radiation received by thevarious sensors. This occurs because in the absence of a player theradiation emitted by the emitters carried by the apparatus segments, orby the central emitter or emitters, is reflected by the ceiling of theroom in which the apparatus is placed, but when a part of the body of aplayer penetrates an emission beam and reflects the radiation to asensor, it is closer to the emitter than the ceiling. It is obvious thatthe closer the reflecting surface is to the emitter, the more intensewill the reflected radiation be. The computer will then receive from thesensor or sensors so affected, within the measuring cycle, a number ofpulses different--greater, in this embodiment, but possibly smaller inother embodiments, as will be explained hereinafter--than that which itreceives during the zeroing operation, viz. the sensing parameter willdeviate from its reference threshold value and reach its activating orupper threshold value. The computer is so programmed as to send to thecontrolled device, whenever this occurs, an appropriate activatinginstruction, which will depend on the nature and operation of thecontrolled device, on the particular sensor to which the sensingparameter relates, and optionally on other conditions or parameterswhich the computer has been programmed to take into account. As noted,the controlled device may be any conventional device for creatingelectrical or electronic signals or signals of another kind; e.g., aninterface, or a terminal apparatus, viz. an instrument or device forproducing the finally desired effect, such as musical tones or opticalimages, the actuation of a safety device, etc., or even anothercomputer. It will be understood that the computer may merely registerthat there is a dynamic stimulus and, therefore, produce in all cases asingle output instruction associated with the particular sensor whichhas received the dynamic stimulus, regardless of the intensity of thelatter, or it may take that intensity into account and outputinstructions which are a function of it, viz., in the example described,a function of the number of pulses received during the measuring cycle,to cause the controlled device to produce effects of differentintensities, e.g., stronger or weaker musical tones.

In this embodiment, each segment of the apparatus is provided with anemitter. However, as has been noted, a single emitter may be used forthe whole apparatus. In this case, during the zeroing operation thesingle emitter will beam its radiation towards the ceiling, and theradiation reflected by the ceiling is that which will be sensed by thesensors. In the zeroing operation there is no obstacle between theceiling and the sensors, and the reflected radiation received by thelatter is at a maximum. When a player operates the apparatus, he willintercept with his body part of the reflected radiation, and theintensity of the radiation received by the sensors will be lower thanduring the zeroing operation. In other words, the dynamic stimuli willconsist in a decrease of the intensity of the radiation received by thesensors. The apparatus will be so arranged as to respond to suchdecrease in the way in which it responds to an increase thereof in theembodiment previously described, viz. it will generate an ON signal inresponse to decrease of the sensed radiation below the lower limitestablished in the zeroing operation--which operation is analogous tothat previously described--and an OFF signal in response to an increaseof the sensed radiation above the upper limit established in the zeroingoperation.

Further to illustrate the invention, a microcontroller program for onesensor/emitter couple is reported hereinafter. The program is written inC. The term "MIDI" indicates a musical instrument digital interface (aprotocol used by all electronic musical instruments).

    ______________________________________                                        PROGRAM                                                                       ______________________________________                                        /* beginning of program */                                                    int    SDT, IN, IDN, ONIN, OFFIN;     /* variables */                         const int ISDT=1, N=10, SN=5, cycle time=30 /* constants */                   main ( )                                                                      zeroing ( );  /* zeroing phase */                                             while (0==0)  /* continues normal operation */                                  {                                                                             IN=measure cycle ( );  /* measure and get result */                           if (IN>ONIN) out on ( );   /* send on signal */                               if (IN<OFFIN) out off ( );  /* send off signal */                             }                                                                           }                                                                             int measure cycle ( )                                                         {                                                                             int transmission, counter;                                                    start timer (CYCLE TIME);                                                     for (transmission=0: transmission<64; transmission++)                           {                                                                             transmit pulse ( );                                                           delay (SDT);                                                                  counter=counter+receive pulse ( );                                            }                                                                           wait end timer ( );                                                           return (counter);                                                             }                                                                             void transmit pulse ( )                                                       {                                                                             /* procedure for transmitting one pulse */                                    }                                                                             int receive pulse ( )                                                         {                                                                             /* procedure for sampling the sensor output and returning                     "1" of sensor high, "0" if sensor low */                                      }                                                                             void start timer (CYCLE TIME)                                                 {                                                                             /* procedure for loading the internal timer to the CYCLE                      TIME=90 msecs, and running it */                                              void wait end timer ( )                                                       {                                                                             /* procedure that waits until the timer measured the time                     loaded to it at start timer ( ) */                                            }                                                                             void out on ( )                                                               {                                                                             /* procedure for sending an "on" code with a note value                       via *"MIDI" protocol to musical instrument */                                 }                                                                             void out off ( )                                                              {                                                                             /* procedure for sensing an "off" code with a note value                      via "MIDI" protocol to musical instrument */                                  }                                                                             void zeroing ( )                                                              {                                                                             SDT=ISDT:         /* set SDT to ISDT                                                                            */                                          IN=measure cycle  /* get first IN value                                                                         */                                          WHILE (IN>(64-(SN+NN)))                                                                         /* proceed until SDT is                                                       proper          */                                            {                                                                             SDT=SDT+1;                                                                    IN=measure cycle ( );                                                         }               /* leaving only if SDT                                                        proper          */                                          IDN=measure cycle ( );                                                        OFFIN = IDN+SN;                                                               ONIN = IDN+SN+NN;                                                             }                                                                             /* end of program */                                                          ______________________________________                                    

This program should be completed and complied according to themicrocontroller which is used.

We used: "INTEL"-8051 microcontroller.

The emitters used: "SEIMENS" SFH205 PIN-PHOTODIODES

The sensors used: "SEIMENS" SFH205 PIN-PHOTODIODES with TBA2800amplifier.

It will be understood that the method which is carried out by theapparatus described in the aforesaid example may be carried out by usingradiations which are different from infrared radiation, e.g., ultrasonicwaves or microwaves. In such cases the apparatus will be adjusted toemit and receive the particular radiation that is being used. The systemwhich involves producing pulses and counting the number of pulsesreceived in a given time interval can still be used, but in other cases,the sensing parameter may not count a number of pulses. It may be, e.g.,a direct measure of a radiation intensity, e.g., a tension or currentproduced by a photoelectric cell, and the correlation between thesensing parameter and the physically definable characteristic of theradiation may be determined by the fact that the sensitivity of the cellmay be adjusted so that the tension or current has a predeterminedreference threshold value in the absence of dynamic stimuli. Theinstruction output by the computer, when the apparatus is in use, is afunction of the difference between the tension or current produced andtheir reference threshold values. In other cases, the sensing parameterand the radiation characteristic may coincide, and the instructionsoutput by the computer will be a function of the difference between thevalue of the characteristic in the absence and in the presence ofdynamic stimuli. This may occur, e.g., when the radiation characteristicis the time gap between the emission of a radiation and its reception bythe sensor. However, in this case also, the radiation may be produced bypulses and the time gap measured for each pulse. The computer will thenzero the apparatus by registering, for each sensor, the time gap in theabsence of dynamic stimuli. It will then register the time gap in thepresence of such stimuli and output an instruction which is the functionof their difference.

A more specific embodiment of the invention is described hereinafterwith reference to FIGS. 5 and 6.

The embodiment in question has two kinds of control outputs: 8-bitparallel, to control video/computer games, and serial, to controlmusical instruments with MIDI protocol.

With reference to FIG. 2, the following components are used: lens 27,focal length 5 cm; lenses 20 and 32, cylindrical, focal length 1.5 cm;and mirrors 22 and 25, front-coated aluminum.

The emitter is placed in the focus of the emitter assembly and thesensor is placed in the focus of the sensor assembly. The lens 32 isplaced empirically in order to achieve the desired sensing beam,preferably between 0.5 cm and 1.5 cm from the sensor.

The zeroing procedure previously described has been applied to theapparatus in various rooms, and it has been found that the values NN=10and SN=5 are optimal values for most environments. In a room with a 2.5m white ceiling the following values were found: SDT=5 and IDN=30. Allthe remaining parameters were calculated using the values of NN and SN.The operating height achieved was 1.2 m for a standard dynamic stimuliobject equivalent to a child's hand. The aforesaid results are for theworst segment. In a room with a 2 m white ceiling the following valueswere found: SDT=8 and IDN=34. The operating height achieved was 1 musing the same standard dynamic stimuli object.

Further illustration lists of electronic components conveniently usablefor the control circuit and the panel circuit of FIGS. 5 and 6 will bedescribed below.

The panel circuit and control circuit are related to the elements of theblock diagram of FIG. 4 as follows: The emitter circuit of FIG. 4includes elements D2, Q1, IRED1, R2, C3, and D1. The remainingcomponents of the panel circuit are included in the sensor circuit.

Elements J2, U2, DZ1, R6, R5, R4, R3, R2, Q1 and Q2 of the controlcircuit form part of the units processor interface of FIG. 4. ElementsU1, X1, C1, C2, C3 and R1 of the control circuit form part of the centerprocessor of FIG. 4. Elements U3 and J4 for operating a computer device,and U1 serial output (pin 10) and J3 for operating an MIDI device whichare in the control circuit, form part of the controller device interfaceof FIG. 4.

    ______________________________________                                        BILL OF ELECTRONIC COMPONENTS                                                 CONTROL CIRCUIT                                                                                                    Recom-                                        Quan-   Refer-                  mended                                   Item tity    ence    Characteristics Part                                     ______________________________________                                        1. Semiconductors                                                              1   1       U1      Microcontroller *4KBYTE                                                                       8051                                                          ROM                                                                           1 usec cycle                                                                  6 I/O bits for panel                                                          control                                                                       serial port for MIDI                                                          8 I/O bits for **external                                                     service                                                   2   1       U2      8 line Analog Multiplexer                                                                     4051                                      3   1       U3      latch/buffer for **external                                                                   74373                                                         device                                                    4   1       U4      voltage regulator                                                                             LM3171                                                        7.5V 100mAmp                                              5   1       U5      voltage regulator                                                                             LM78L05                                                       5V 100mAmp                                                6   2       Q1,Q2   small signal low frequency                                                                    2N2222                                                        switching transistor                                                          VCE=10V                                                                       IC=50mAmps                                                                    NPN                                                       7   1       Q2      small signal low frequency                                                                    2N2907                                                        switching transistor                                                          VCE=10V                                                                       IC=50mAmps                                                                    PNP                                                       8   1       DZ1     Zener diode 4.9V 0.25W                                    9   1       LED1    visible LED 50mAmps                                      10   1       X1      crystal 12 MHz                                            *Required for complex configuration. 2 Kbytes sufficient for basic            configuration.                                                                **Required only if external device control operational.                      2. Capacitors                                                                 11   3       C6,     IC's                                                                  C7,C8   decoupling caps                                                               10NF                                                     12   2       C1,C2   30PF                                                     13   1       C3      power on reset                                                                10UF/10V                                                 14   1       C4      regulator                                                                     decoupling cap                                                                2.2UF                                                    15   1       C5      regulator                                                                     decoupling cap                                                                2.2UF                                                    3. Resistors                                                                  16   2       R1,R3   1K              0.25W                                    17   2       R2,R7   10K             0.25W                                    18   2       R8,R4   200             0.25W                                    19   1       R5      2K              0.25W                                    20   1       R6      100             0.25W                                    21   1       R9      560             0.25W                                    22   1        R10    2.7K            0.25W                                    4. Connectors                                                                  23  1       J1      power input                                                                   2 pin                                                                         10V 0.3Amps                                              24   1       J3      MIDI output                                                                   3 pin                                                                         5V low current                                           25   1       J4      *external device output                                                       9 pin                                                                         5V low current                                           ______________________________________                                         *Required only if external device control operational.                   

    ______________________________________                                        BILL OF ELECTRONIC COMPONENTS                                                 PANEL CIRCUIT                                                                                                       Recom-                                       Quan-   Refer-                   mended                                  Item tity    ence     Characteristics Part                                    ______________________________________                                        1. Semiconductors                                                             1    1       U1       IR preamplifier TBA2800                                                       70DB gain                                               2    1       IRED1    near IR radiation                                                                             OP240A                                                        3Amps peak current at                                                                         (Optek)                                                       1 usec 300 pps                                                                100mW power dissipation                                 3    1       PD1      wavelength matches IRED1                                                                      SFH205                                                        NEP=3.7E-14     (Sei-                                                         [Watt/Sqrt (HZ)]                                                                              mens)                                   4    1       Q1       VCC=10V                                                                       3Amps peak current at                                                         1 usec 300 pps                                                                100mW power dissipation                                                       HFE=200                                                 5    1       Q2       small signal switching                                                                        2N2222                                                        transistor                                                                    VCC=10V                                                                       IC=50mAmps                                              6    1       D1       rectifying diode                                                                              IN4001                                                        100mAmps                                                                      10V                                                     7    1       DZ1      Zener diode                                                                   5.1V 0.25W                                              2. Capacitors                                                                 8    1       C1       10N/10V                                                 9    2       C2,C3    100U/6V                                                 10   1       C4       2.2U/6V                                                 11   1       C5       33U/6V                                                  12   11      C6       I1.5N/6V                                                3. Resistors                                                                  13   1       R1       10              0.25W                                   14   1       R2       10K             0.25W                                   15   1       R3       1K              0.25W                                   16   2       R4,R5    100             0.25W                                   ______________________________________                                    

While the invention is particularly applicable to the control of musicalinstruments or computer-operated visual games, it is applicable to thecontrol of different apparatuses. For instance, it can be used as asafety device to prevent or discontinue operation of a machine, anelevator or the like, whenever a part of the body of a player or anyother person is located where it could be endangered by the operation ofthe machine. In this case, the presence of such a part of the body of aperson constitutes the dynamic stimulus which activates the apparatusaccording to the invention, and the zeroing operation is conductedtaking into account the nature of dynamic stimulus.

Another embodiment of the present invention is disclosed in FIGS. 7-10.This embodiment is particularly adapted to address the needs of videocomputer games, such as the Sega Genesis System. Again, a plurality ofindividual panels, each having an individual emitting LED circuit 100,for example, in the infrared range, and an individual sensor member orphotodiode 102 is provided. FIG. 7 discloses the schematic circuitry forone slave panel 134, which is responsive to a microprocessor unit 104contained within a master panel member 132. The master panel member 132contains a stored program having appropriate algorithms to processinformation from the respective slave panels 134 to enable a player tocontrol a video game.

As seen in FIGS. 9 and 10, an illustration of the interface of a playerwith an optical controller 136 of this embodiment is disclosed. Theoptical controller 136 is connected to a video game processing unit 138,which is only schematically shown and can constitute a commercialproduct such as the Sega Genesis Video Game System. Game cartridges 142can store game instructions on a ROM, as known in the industry, forprojecting video signals that can be controlled with a player interfaceonto a video monitor or television display 144. For ease of illustrationthe video display is exaggerated in FIGS. 9 and 10.

As can be readily appreciated, video game processing units 138 arecapable of using other than a ROM cartridge 142 for the storage ofgames, such as a CD disk, which has the capability of providing agreater storage capacity and more intricate game play and images. In aconventional video game processing unit 138, a hand-held controller (notshown) having generally eight functional control switches has beenutilized for controlling an interaction between the player and theprogress of the game displayed on the television screen 144.

Numerous attempts have been provided to simplify such a hand-heldcontroller to facilitate the ability of the player to enjoy the game.The optical controller 136 of the present invention has the capacity, inthis particular embodiment, to provide 16 control switching functions,since each one of the panel units that make up the optical controller136 can distinguish between the position of a hand, as shown in FIG. 9,for a player 146, and the position of a foot, as shown in FIG. 10. Thus,the present invention not only encourages the player to create a feelingof identity and simulation with a corresponding video character 148, butfurther enables the player to naturally take advantage of the increased16-function control switching capacities of the optical controller 136without being encumbered by holding a hand controller of theconventional configuration. The player 146, when stepping within thesurrounding radiation shield collectively provided by the individualpanel units, can become immersed in playing the game, since his hand andfoot movements will appear by themselves to be directly translated intothe simulated movements of the video character 148. Since the radiationshield can be formed of an infrared energy, the only apparentinteraction with the radiation shield will be the correspondingsimulated movement of the video character 148.

As can be readily appreciated, the optical controller 136 of the presentinvention is highly advantageous with boxing, martial arts, and othersport action games. The optical controller 136, however, having a largernumber of control functions than the manual switches of the conventionalhand controller, is also capable of not only simulating the handcontroller so that a particular panel and a particular high or lowposition on the panel, can each correspond to the conventionalcontroller hand button, but further, the remaining additional switchingfunctions of the panel units can enable the optical controller 136 toprovide alternative control functions. For example, if one button of aconventional controller is dedicated to be a firing button for aparticular action video game, that control function can be emulated byone of the panel units of the optical controller 136. Another panelunit, however, or a high or corresponding low position on the samepanel, can provide an enhanced firing capability, for example, for arapid fire capability that would be incapable of being accomplished bythe manual manipulation of the conventional hand controller button. Theprocessor 104 in the master panel 132 can, for example, when sensing theactivation of the enhanced panel functioning switch, pulse the firingsignals on the conventional communication line to the video gameprocessing unit at a much higher frequency to create a machine gun-likefiring capacity. This enhanced game functioning play can, of course, beaccomplished without any apparent player manipulation of a mechanicalcontrol feature on a controller. The player simply uses the dynamicstimulus of his own body in interfacing with a radiation emission spaceabove the particular panel unit.

The processor 104 can be programmed to interface with games (or otherdevices) that are not designed to utilize all 16 functional controlsignals (assuming a hexagonal panel configuration) of the outputsignals. For example, a standard Genesis game cartridge accepts eightfunctional input control signals from a conventional hand controller(not shown); however, the optical controller 136 is able to provide atleast twice that many. The optical controller 136 can recognize, bypolling the appropriate addresses of the game data stored in the gamemedium, when a standard Genesis game is interfaced therewith, and itsprocessor 104 can switch to a protocol designed to accommodate theinterface's limitations.

By multiplexing the optical controller 136 outputs through the 8-to-4decoder 110, the processor 104 enables an attached standard Genesis gameto further utilize the capabilities of the optical controller 136 whenthe player activates the game inputs in a particular manner recognizableto the optical controller 136 via its programming. For example, aplayer's activation of one panel with his hand, while simultaneouslyactivating another panel with his foot, might cause the data normallypresent on a first data line to be replaced with data present on a ninthdata line.

As an example, a first data line could provide a firing control signallimited by the manual depressing of a button on a conventionalcontroller, while the ninth data line would provide firing controlsignals at a high repetition rate to create a machine gun firing actionwhich would constitute enhanced play action.

Referring to FIG. 7, the processor chip 104 can first initialize thevariables utilized in its computations. As described earlier, variousthresholds can be set and are updated depending upon the reflectivecharacteristics of the room within which the optical controller is to beoperated. In this embodiment, a single emitter such as that which iscontained within LED circuit 100 is mounted on each of the individualpanels, and a single sensor member or photodiode 102 will sense thereflected radiation from the position of a player appendage such as thehand/arm or foot/leg of the player 146. The optical system, shown inFIG. 2a-d, complementing the emission of the radiation from LED circuit100 will spread the emitted radiation into an elongated emission spaceabove the specific panel unit so that the radiation in one lateraldirection will be simultaneously spread to a lesser degree than in aradial direction to provide a truncated emission space. Since thisradiation is being simultaneously emitted throughout this space, when ahand, as shown in FIG. 9, is inserted into this radiation space, theamount of energy reflected back to the sensor member 102 will be afunction of the relative height of the appendage from the emittingsource of radiation. The position of an appendage such as a foot or legat a lower height will reflect a larger percentage of radiation back tothe sensor member 102. Since it is assumed that the player 146 willoperate the game while standing in an upright position, an empiricaldetermination of a threshold value of radiation received by the sensorcan be utilized to determine whether or not the appendage inserted bythe player 146 is, in fact, a hand/arm or a foot/leg. Thus, adetermination can be made of the relative position of the appendage orobject in the emission space, depending upon the quantity of radiationthat is received by the sensor member 102.

Thus, the intensity of the light received by a panel's photodiodesensing member 102 during a predetermined time interval is indicative ofwhether or not a hand/arm or foot/leg has been inserted within theoptical path of the radiation space corresponding to that particularpanel. The processor 104 in the master panel 132 can cause a sequentialscanning of each of the slave panels 134 to determine the status of eachpanel unit. It should be noted that each of the emitter members on eachpanel unit is not fired simultaneously, but is sequentially fired toprevent erroneous radiation from being received by other sensor membersof the other panel units. This permits each panel unit to have identicalemitter and sensor components.

The status of each panel unit is determined by comparing valuescorresponding to the intensity of the light received by each panel(hereinafter COUNTER₋₋ HX represents this value) with the followingthresholds: OFF₋₋ LEVEL, ON₋₋ LEVEL, and LOW₋₋ LEVEL.

If COUNTER₋₋ HX<OFF₋₋ LEVEL, then the panel unit enters into "OperatePanel Off" mode. If OFF₋₋ LEVEL<COUNTER₋₋ HX<ON₋₋ LEVEL, there is nochange in the operation mode. If COUNTER₋₋ HX>ON₋₋ LEVEL, then the panelunit enters into "Operate Panel On" mode. Similarly, if COUNTER₋₋HX>LOW₋₋ LEVEL, then the panel unit enters into "Operate Panel Low"mode.

The aforementioned processor 104, referred to in FIG. 7 as U5, enablesthe electronic's transmitter logic 106, thereby firing the panel's LEDcircuit 100, enabling the receiver circuitry 108, and setting up thenext panel unit. FIG. 7 illustrates a preferred embodiment oftransmitter logic 106 consisting of NAND gates 112, 114, 116, and 118, Dflip-flop 120, and transistor 122. Additionally, power stabilizingcircuit 124 is shown connected to D flip-flop 120 and photodiode 102.

A signal corresponding to the intensity of the light emitted from LEDcircuit 100 and received by photodiode 102 is output by photodiode 102to receiving circuit 108. Receiving circuit 108 may be a TBA 2800infrared preamplifier chip made by ITT or a similar device that iscapable of outputting pulses varying in width, wherein such variance isindicative of the magnitude or intensity of radiation of signalsreceived by the receiving circuit 108 over a predetermined timeinterval. Variations in the aforementioned pulse width conveyinformation which can be utilized by the processor 104 to identify theobject which has traversed the optical path between LED circuit 100 andphotodiode 102. This can be accomplished by empirically identifying anintensity level which can be used for comparison purposes to distinguishbetween an object in an upper space of a panel radiation space (e.g.,hand/arm) and a lower space (e.g., foot/leg).

The pulses output from receiving circuit 108 further provide an input toNAND gate 118 within transmitter logic 106. Processor 104, which, in apreferred embodiment, may be an Intel 8051 chip, provides outputs P1.0and P1.1 to transmitter logic 106 and receives an interrupt signal INT1therefrom. More specifically, output P1.0 is provided to NAND gate 116as an input and to D flip-flop 120 as a clock. Processor 104's outputP1.1 is provided as an input to D flip-flop 120 and as an input to NANDgate 114.

When signal P1.1 goes "high", the transmitter logic is enabled. NANDgate 118 receives the Q output of D flip-flop 120 and the aforementionedoutput signal from receiving circuit 108 and provides an input totransistor 122. The output of transistor 122 is connected to the DATAline and output to processor 104 as an interrupt signal INT1. Thisinterrupt indicates that the receiver circuit 108 has received LEDcircuit 100's light emission and that receiver circuit 108 has outputinformation corresponding thereto in the form of a pulse. When processor104 receives interrupt signal INT1, the appropriate counters are resetprior to firing the next panel's LED circuit 100.

LED circuit 100 includes firing circuitry which is connected to theoutput of NAND gate 112 of transmitter logic 106. NAND gate 112 firesLED circuit 100 in response to processor 104's outputs P1.0 and P1.1, asis illustrated in FIG. 7.

Processor 104 interfaces with the video game processing unit 138 via an8-to-4 decoder 110 which acts as a multiplexer. The game processing unit138, via connector P2, sends a signal INT0 to 8-to-4 decoder 110 toindicate which data the game processing unit 138 is ready to receivefrom processor 104.

FIG. 8 is a flow chart representation of the algorithms executed byprocessor 104. After power is initially applied to processor 104,initialization 130 of processor 104's variables is automaticallyperformed. Thereafter, processor 104 enters into loop 140 (the secondstep of processor's 104 autozeroing routine) wherein processor 104 scansthe panels until it has determined that the system is stabilized.

The final portion of the aforementioned autozeroing routine consists ofstep 150 wherein a variable (e.g., ON₋₋ LEVEL) for each panel is set toan operating reference level, the determination of which depends uponthe ambient conditions within which the system is being operated.

FIG. 8, in step 160, further shows how processor 104 differentiatesbetween a player's hand and foot by scanning the panels, summing theresults of the scanning over a predetermined time interval, and storingthe results thereof. In a preferred embodiment, the aforementionedstored values are indicative of the amount of light intensity reflectedback toward and received by each panel. Such values necessarily fallwithin numerical regions defined by threshold values stored withinprocessor 104.

Steps 170 and 180 illustrate that processor 104 responds to a level ofreceived light falling below an OFF₋₋ LEVEL threshold by deactivatingthe game panel. When there is no interference with the optical pathbetween LED circuit 100 and photodiode 102, the reflected level of lightfalls below the OFF₋₋ LEVEL threshold when the system is properlycalibrated.

If the intensity of light received by a panel exceeds the aforementionedOFF₋₋ LEVEL threshold and is below another threshold called the ON₋₋LEVEL threshold, the system deems the received light to be within theboundary of a noise band defined by these two thresholds. When thereceived intensity level is as described immediately above, step 190shows that processor 104 does not change the operational status of thesystem in response to what is categorized as mere noise.

However, when the reflected and thereafter received light is of anintensity which is above the ON₋₋ LEVEL threshold, steps 190 and 200illustrate that processor 104 activates the game panel in responsethereto. The level of received light is higher because either theplayer's hand or foot has interfered with the optical path between LEDcircuit 100 and photodiode 102. Step 210 shows how the processor 104utilizes an additional threshold, LOW₋₋ LEVEL threshold, to distinguishbetween the player's hand/arm and foot/leg.

A greater amount of light is typically reflected back toward the panelwhen the player's foot crosses the optical path than when the player'shand crosses therethrough because of the relative vertical position tothe emitter member 100 (see FIG. 10). Accordingly, and as illustrated bysteps 210, 220, and 230, the amount of light received by the panel whenthis stage of the processing algorithm is reached will necessarily fallabove or below the LOW₋₋ LEVEL threshold. When the amount of lightreceived falls below the LOW₋₋ LEVEL threshold, step 220 shows thatprocessor 104 thereafter determines that the player's hand is over thepanel. Conversely, when the amount of light received is above thelow-level threshold, step 230 shows that processor 104 thereafterdetermines that the player's foot is over the panel.

FIG. 11 discloses schematic program steps for a game processor unit(GPU) interrupt. Step 240 indicates that any panel unit transmission ofIR will be stopped in order to prevent a power overload on anyindividual panel unit LED circuit 100. Step 250 is a decisional step tocheck the game status and, more particularly, to determine if anordinary or regular game cartridge or game data has been inserted intothe game processing unit 138, or whether game data capable of utilizingthe full functions of the optical controller 136 capability has beeninserted. The optical controller 136 is designed to emulate a regularhand controller by default. Accordingly, if the decision at step 250 isthat a regular game capability is indicated on one of the communicationlines from the game processor unit 138, then the optical controller 136will function to emulate a standard hand controller. Alternatively, ifan optical controller capability is indicated, then at step 260 a signalwill be generated to indicate an optical controller interface with thegame processor unit 138. At step 270, data will be transferred, that isfunctional control signals, using an optical controller protocol to theGPU.

An additional flow chart is shown in FIG. 12 to broadly describe aprogram for controlling the optical controller 136. An initiation steptakes place at step 280, followed by a step of enabling the scanninginterrupt at step 290. At step 300, a predetermined scan cycle of thepanel units is instigated to provide measurement data to permit, at step310, the setting of operating reference values. If an error is detectedat step 320; for example, if the optical controller 136 detectsabnormally high intensity reflections in one of the panels during thedetermination of the operating threshold values, the procedure of steps300 and 310 are repeated. Subsequently, the game processing unitinterrupts are enabled at step 330. At step 340 the program can serviceboth the operational scanning to determine the input of control signals,and the GPU interrupts and, in addition, can perform enhanced powerfunctions. As can be appreciated, the enhanced power functions describedabove are performed by the optical controller, and the game will acceptthose signals in the ordinary play of the game.

Referring to FIG. 13, a simplified flow chart of the scanning interruptis disclosed. At step 350 the panels are scanned and the radiation thathas been sensed as output signals is accumulated. At step 360 there isan updating of the entire panel status, and there is an output of theemulation results to the GPU. Finally, at step 370 the program sets thetimeout value for the next interrupt scan.

While some embodiments of the invention have been described, it will beunderstood that the invention can be carried into practice with a numberof variations, modifications, and adaptations, without departing fromthe spirit of the invention or from the scope of the claims.

What is claimed is:
 1. A self-calibratable controller for controlling adevice upon detecting an object in an environment, comprising:a)activatable radiation means for sensing radiation in the environment andgenerating an output indicative of the sensed radiation; and b) controlmeans responsive to the output of the activatable radiation means andhaving a regulatable sensitivity, said control means including:i)self-calibration means for calibrating the controller to operate in theenvironment, including means for activating the radiation means to senseradiation in the environment in a self-calibration state in which theobject is absent from the environment; ii) means for determining areference paramenter indicative of the radiation sensed in theself-calibration state; iii) operating means for maintaining theradiation means activated to sense radiation in the environment in anoperating state in which the object is present in the environment; iv)said determining means being further operative for determining a sensingparamenter indicative of the radiation sensed in the operating state; v)means for comparing the reference and sensing parameters, and forresponsively generating an output control signal to control the device;and vi) means for regulating the sensitivity of the control means to theoutput of the radiation means during the self-calibration state.
 2. Thecontroller according to claim 1, and further comprising a support forsupporting the radiation means, and wherein the radiation means includesemitter means for emitting a light beam into an emission space, andsensor means for sensing light over a sensing space, said spacesextending away from the support and at least partially overlapping eachother in an overlapping region.
 3. The controller according to claim 2,wherein the emitter means includes an infrared light source, and whereinthe sensor means includes an infrared sensor.
 4. The controlleraccording to claim 2, wherein the radiation means includes means forshaping at least one of said spaces to have a generally thin,screen-like volume having a cross-sectional width and a cross-sectionalthickness less than said width substantially throughout its volume. 5.The controller according to claim 4, wherein the shaping means includesa cylindrical lens.
 6. The controller according to claim 1, wherein theradiation means includes sensor means for receiving the radiation havinga variable intensity, and wherein the determining means includes meansfor measuring the intensities of the received radiation as theparameters in both states.
 7. The controller according to claim 6,wherein the radiation means is pulsatable, and further comprising meansfor pulsing the radiation means to generate radiation pulses, andwherein the determining means is operative for counting how many of theradiation pulses are generated in each state over a measuring cycle. 8.The controller according to claim 6, wherein the radiation means ispulsatable, and further comprising means for pulsing the radiation meansto generate radiation pulses having pulse widths, and wherein thedetermining means is operative for measuring the pulse widths in eachstate over a measuring cycle.
 9. The controller according to claim 1,and further comprising means for periodically updating the referenceparameter.
 10. The controller according to claim 1, wherein the controlmeans includes means for establishing a predetermined operatingparameter, and for generating the output control signal when the sensingparameter exceeds the predetermined operating parameter.
 11. Thecontroller according to claim 1, wherein the control means includesmeans for establishing two predetermined operating parameters, and forgenerating an actuating signal for actuating the device when the sensingparameter is greater than one of the operating parameters, and forgenerating a deactuating signal for deactuating the device when thesensing parameter is less than the other of the operating parameters,and for generating a no-change signal when the sensing parameter isintermediate the operating parameters.
 12. The controller according toclaim 1, wherein the control means includes means for processing theoutput control signal to be indicative of a relative distance betweenthe object and the radiation means.
 13. The controller according toclaim 1, and further comprising a support for the radiation means, thesupport including a plurality of housings; and wherein the radiationmeans includes a plurality of radiation assemblies, one on each housing;and wherein the control means is operative for activating the radiationassembly on each housing to determine the reference parameter for eachradiation assembly.
 14. The controller according to claim 13, whereinthe housings are arranged adjacent one another, and wherein eachradiation means includes means for shaping at least one of said spacesto have a generally thin, screen-like volume having a cross-sectionalwidth and a cross-sectional thickness less than said width substantiallythroughout its volume, and wherein the volumes are arranged adjacent oneanother to form a curtain.
 15. The controller according to claim 1, andfurther comprising a support for the radiation means, the support beingmounted on a floor of a room in front of a human player having anappendage that serves as the object; and wherein the device is a videogame associated with a display; and wherein the control means includesmeans for processing the output control signal to change a position ofan image on the display.
 16. A method of controlling a device upondetecting an object in an environment, comprising the steps of:a)calibrating a controller to operate in the environment by initiallyreceiving radiation from the environment in a self-calibration state inwhich the object is absent from the environment, and determining areference parameter indicative of the radiation received from theenvironment in the self-calibration state; b) placing an object in theenvironment; c) subsequently receiving radiation from the object in anoperating state, and determining a sensing parameter indicative of theradiation received from the object in the environment in the operatingstate; d) comparing the reference and sensing parameters, andresponsively generating an output control signal to control the device;and e) regulating the sensitivity of the controller to the radiationreceived.
 17. The method according to claim 16, and further comprisingthe step of transmitting a light beam into an emission space in eachstate, and wherein the receiving steps are performed by sensing lightover a sensing space that at least partially overlaps the emissionspace.
 18. The method according to claim 17 , wherein the transmittingand receiving steps include the step of shaping at least one of saidspaces to have a generally thin, screen-like volume having across-sectional width and a cross-sectional thickness less than saidwidth substantially throughout its volume.
 19. The method according toclaim 16, wherein the determining steps are performed by determining theintensities of the received radiation as the parameters.
 20. The methodaccording to claim 19, wherein the determining steps are performed bygenerating radiation pulses and counting how many of the radiationpulses are generated over a measuring cycle.
 21. The method according toclaim 19, wherein the determining steps are performed by generatingradiation pulses having pulse widths and measuring the pulse widths overa measuring cycle.
 22. The method according to claim 16, and furthercomprising the step of periodically updating the reference parameter.23. The method according to claim 16, wherein the comparing andgenerating steps are performed by establishing a predetermined operatingparameter, and generating the output control signal when the sensingparameter exceeds the predetermined operating parameter.
 24. The methodaccording to claim 16, Wherein the comparing and generating steps areperformed by establishing two predetermined operating parameters, andgenerating an actuating signal for actuating the device when the sensingparameter is greater than one of the operating parameters, andgenerating a deactuating signal for deactuating the device when thesensing parameter is less than the other of the operating parameters,and generating a no-change signal when the sensing parameter isintermediate the operating parameters.
 25. The method according to claim16, and further comprising the step of processing the output controlsignal to be indicative of a relative distance between the object and asupport.
 26. The method according to claim 16, wherein the device is avideo game having a display; and further comprising the step ofprocessing the output control signal to change the position of an imageon the display.
 27. A video game system, comprising:A) a display; B) agame processor means for processing game data and displaying theprocessed data on the display; and C) a self-calibratable, video gamecontroller for interactively controlling the game processor means inresponse to detection of a player in an environment, said controllerincludinga) activatable radiation means for sensing radiation in theenvironment, b) means for activating the radiation means to senseradiation in the environment in a self-calibration state in which theplayer is absent from the environment, c) means for determining areference parameter indicative of the radiation sensed in theself-calibration state, d) operating means for maintaining the radiationmeans activated to sense radiation in the environment in an operatingstate in which the player is present in the environment, e) saiddetermining means being further operative for determining a sensingparameter indicative of the radiation sensed in the operating state, andf) control means for comparing the parameters, and for responsivelygenerating an output control signal to control the game processor means.28. The system according to claim 27, and further comprising a supportfor supporting the radiation means, and wherein the radiation meansincludes emitter means for emitting a light beam into an emission space,and sensor means for sensing light over a sensing space, said spacesextending away from the support and at least partially overlapping eachother in an overlapping region.
 29. The system according to claim 28,wherein the radiation means includes means for shaping at least one ofsaid spaces to have a generally thin, screen-like volume having across-sectional width and a cross-sectional thickness less than saidwidth substantially throughout its volume.
 30. The system according toclaim 27, and further comprising a support for the radiation means, thesupport including a plurality of housings; and wherein the radiationmeans includes a plurality of radiation assemblies, one on each housing;and wherein the control means is operative for activating the radiationassembly on each housing to determine the reference parameter for eachradiation assembly.
 31. The system according to claim 30, wherein thehousings are arranged adjacent one another, and wherein each radiationmeans includes means for shaping at least one of said spaces to have agenerally thin, screen-like volume having a cross-sectional width and across-sectional thickness less than said width substantially throughoutits volume, and wherein the volumes are arranged adjacent one another toform a curtain.
 32. A self-calibratable instrument for determining thepresence or absence of a dynamic stimulus in a sensing space,comprising:sensing means for sensing radiation from said sensing spaceand for generating output sensing signals in response thereto, saidradiation having a characteristic indicative of the presence or absenceof said dynamic stimulus in said sensing space, said sensing signalshaving a sensing parameter which comprises a measure of saidcharacteristic of said radiation; and processing means for receiving andprocessing said sensing signals; said processing means includingself-calibration means for adapting said instrument to operate properlyin various and changing environments of use in such a manner that saidprocessing means distinguishes between those sensing signals having asensing parameter representative of the presence of said dynamicstimulus and those sensing signals whose sensing parameters arerepresentative solely of electronic noise or optical noise indigenous tosaid environment of use; said self-calibration means including means forinitially setting the sensitivity of said processing means such thatsaid processing means is responsive to said noise signals in the absenceof a dynamic stimulus and for adjusting the sensitivity of saidprocessing means until said responsiveness to said noise signalsdiminishes to a predetermined level.
 33. A self-calibratable controllerfor controlling a device upon detecting an object in an environment,comprising:a) activatable radiation means including a plurality ofradiation assemblies, each operative for sensing radiation in theenvironment; b) self-calibration means for calibrating the controller tooperate in the environment, including means for sequentially activatingeach radiation assembly to sense radiation in the environment in aself-calibration state in which the object is absent from theenvironment; c) means for determining a reference parameter indicativeof the radiation sensed in the self-calibration state for each radiationassembly; d) operating means for sequentially activating each radiationassembly to sense radiation in the environment in an operating state inwhich the object is present in the environment; e) said determiningmeans being further operative for determining a sensing parameterindicative of the radiation sensed in the operating state for eachradiation assembly; and f) control means for comparing the parametersfor each radiation assembly, and for responsively generating an outputcontrol signal to control the device.
 34. A self-calibratable,dynamically activated optical instrument for producing control signals,comprising:sensor means for generating sensor output signals in responseto radiation received from a sensing space; processor means forgenerating control signals in response to said sensor output signals;said processor means including self-calibration means for automaticallycalibrating said processor means to inhibit control signals when adynamic stimulus is absent from said sensing space and to permit saidprocessor means to generate control signals when a dynamic stimulus ispresent in said sensing space, said self-calibrating means initiallyincreasing the sensitivity of said processor means until control signalsare generated in the absence of said dynamic stimulus in said sensingspace and subsequently decreasing said sensitivity of said processormeans at least until no control signals are generated in the absence ofsaid dynamic stimulus in said sensing space.
 35. The instrument of claim34 further comprising emission means for emitting radiation into anemission space, said sensing space and said emission space at leastpartially overlapping, and said instrument generating control signals inresponse to that portion of the emitted radiation which is reflectedfrom said dynamic stimulus and received by said sensor.
 36. Theinstrument of claim 35 wherein said sensor output signals include asensing parameter which is a measure of a characteristic of saidreceived radiation.
 37. The instrument of claim 36 wherein saidcharacteristic is the intensity of the radiation.
 38. The instrument ofclaim 37 wherein said emitted radiation is emitted as pulses, saidsensor output signal is a pulse generated by sensor reception of one ofsaid emission pulses, and said sensing parameter is the length of thesensor output pulse.
 39. The instrument of claim 38 wherein saidself-calibration means effects self-calibration by sampling, during asampling cycle, a predetermined number of sensor output pulses apredetermined time period after the emission of the correspondingemitted pulse, and said sensitivity is adjusted by initially samplingsaid sensor output pulses virtually immediately after the emission ofsaid emitted pulse and thereafter incrementally increasing the delaytime for sampling said sensor output pulses until the number of sensoroutput pulses sensed is below a predetermined minimum.
 40. Theinstrument of claim 36 wherein said characteristic and said sensingparameter comprises the intensity of the received radiation.